Add automatic set of CUDA_VISIBLE_DEVICES for local scheduler
#383
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
facebook-github-bot
added
CLA Signed
|
This pull request was exported from Phabricator. Differential Revision: D34064433 |
Codecov Report
@@ Coverage Diff @@
## main #383 +/- ##
==========================================
- Coverage 94.62% 94.57% -0.06%
==========================================
Files 66 66
Lines 3554 3593 +39
==========================================
+ Hits 3363 3398 +35
- Misses 191 195 +4
Continue to review full report at Codecov.
|
aivanou
added a commit
to aivanou/torchx-1
that referenced
this pull request
Feb 8, 2022
…-pytorch#383) Summary: Pull Request resolved: meta-pytorch#383 The diff adds automatic set of `CUDA_VISIBLE_DEVICES` based on `num_replicas`. Each replica gets the same number of devices The alg. applies only when `CUDA_VISIBLE_DEVICES` is not set The diff uses `nvidia-smi` to determine the number of GPUs meta-pytorch#297 meta-pytorch#377 Differential Revision: D34064433 fbshipit-source-id: 788ce92b0ad79e24f4be22bb2d5e9f784f25004b
aivanou
force-pushed
the
export-D34064433
branch
from
0584f73 to
328bcc6
Compare
|
This pull request was exported from Phabricator. Differential Revision: D34064433 |
aivanou
added a commit
to aivanou/torchx-1
that referenced
this pull request
Feb 9, 2022
…-pytorch#383) Summary: Pull Request resolved: meta-pytorch#383 The diff adds automatic set of `CUDA_VISIBLE_DEVICES` based on `num_replicas`. Each replica gets the same number of devices The alg. applies only when `CUDA_VISIBLE_DEVICES` is not set The diff uses `nvidia-smi` to determine the number of GPUs meta-pytorch#297 meta-pytorch#377 Differential Revision: D34064433 fbshipit-source-id: 17c9df4d22e2c56ee65739db22714499e8daff18
aivanou
force-pushed
the
export-D34064433
branch
from
328bcc6 to
770dfb4
Compare
|
This pull request was exported from Phabricator. Differential Revision: D34064433 |
aivanou
added a commit
to aivanou/torchx-1
that referenced
this pull request
Feb 9, 2022
…-pytorch#383) Summary: Pull Request resolved: meta-pytorch#383 The diff adds automatic set of `CUDA_VISIBLE_DEVICES` based on `num_replicas`. Each replica gets the same number of devices The alg. applies only when `CUDA_VISIBLE_DEVICES` is not set The diff uses `nvidia-smi` to determine the number of GPUs meta-pytorch#297 meta-pytorch#377 Differential Revision: D34064433 fbshipit-source-id: 1bdada1765b6ce740c64e434b079353df4acb702
aivanou
force-pushed
the
export-D34064433
branch
from
770dfb4 to
0184da4
Compare
|
This pull request was exported from Phabricator. Differential Revision: D34064433 |
1 similar comment
|
This pull request was exported from Phabricator. Differential Revision: D34064433 |
aivanou
added a commit
to aivanou/torchx-1
that referenced
this pull request
Feb 10, 2022
…-pytorch#383) Summary: Pull Request resolved: meta-pytorch#383 The diff adds automatic set of `CUDA_VISIBLE_DEVICES` based on `num_replicas`. Each replica gets the same number of devices The alg. applies only when `CUDA_VISIBLE_DEVICES` is not set The diff uses `nvidia-smi` to determine the number of GPUs meta-pytorch#297 meta-pytorch#377 Differential Revision: D34064433 fbshipit-source-id: e9641e93fb487b38000f77c88b550a3149443f75
aivanou
force-pushed
the
export-D34064433
branch
from
0184da4 to
f4fb0bf
Compare
|
This pull request was exported from Phabricator. Differential Revision: D34064433 |
aivanou
added a commit
to aivanou/torchx-1
that referenced
this pull request
Feb 14, 2022
…-pytorch#383) Summary: Pull Request resolved: meta-pytorch#383 The diff adds automatic set of `CUDA_VISIBLE_DEVICES` based on `num_replicas`. Each replica gets the same number of devices The alg. applies only when `CUDA_VISIBLE_DEVICES` is not set The diff uses `nvidia-smi` to determine the number of GPUs meta-pytorch#297 meta-pytorch#377 Differential Revision: D34064433 fbshipit-source-id: de22a96744bb5f625d331c970f529cb5d316ed27
aivanou
force-pushed
the
export-D34064433
branch
from
f4fb0bf to
73d2666
Compare
aivanou
added a commit
to aivanou/torchx-1
that referenced
this pull request
Feb 14, 2022
…-pytorch#383) Summary: Pull Request resolved: meta-pytorch#383 The diff adds automatic set of `CUDA_VISIBLE_DEVICES` based on `num_replicas`. Each replica gets the same number of devices The alg. applies only when `CUDA_VISIBLE_DEVICES` is not set The diff uses `nvidia-smi` to determine the number of GPUs meta-pytorch#297 meta-pytorch#377 Differential Revision: D34064433 fbshipit-source-id: 8436d962d4a3444608b4f86eb507598487c2cc5b
|
This pull request was exported from Phabricator. Differential Revision: D34064433 |
aivanou
force-pushed
the
export-D34064433
branch
from
73d2666 to
d0c3a7b
Compare
aivanou
added a commit
to aivanou/torchx-1
that referenced
this pull request
Feb 14, 2022
…-pytorch#383) Summary: Pull Request resolved: meta-pytorch#383 The diff adds automatic set of `CUDA_VISIBLE_DEVICES` based on `num_replicas`. Each replica gets the same number of devices The alg. applies only when `CUDA_VISIBLE_DEVICES` is not set The diff uses `nvidia-smi` to determine the number of GPUs meta-pytorch#297 meta-pytorch#377 Differential Revision: D34064433 fbshipit-source-id: fe30725bc81876e8dd712f311f86cfb66ba658fd
aivanou
force-pushed
the
export-D34064433
branch
from
d0c3a7b to
49f5d5d
Compare
|
This pull request was exported from Phabricator. Differential Revision: D34064433 |
aivanou
added a commit
to aivanou/torchx-1
that referenced
this pull request
Feb 15, 2022
…-pytorch#383) Summary: Pull Request resolved: meta-pytorch#383 The diff adds automatic set of `CUDA_VISIBLE_DEVICES` based on `num_replicas`. Each replica gets the same number of devices The alg. applies only when `CUDA_VISIBLE_DEVICES` is not set The diff uses `nvidia-smi` to determine the number of GPUs meta-pytorch#297 meta-pytorch#377 Differential Revision: D34064433 fbshipit-source-id: 8db12112f924c8d66b935d6b98f3a186ea5fa08c
aivanou
force-pushed
the
export-D34064433
branch
from
49f5d5d to
3fc8732
Compare
|
This pull request was exported from Phabricator. Differential Revision: D34064433 |
aivanou
added a commit
to aivanou/torchx-1
that referenced
this pull request
Feb 15, 2022
…-pytorch#383) Summary: Pull Request resolved: meta-pytorch#383 The diff adds automatic set of `CUDA_VISIBLE_DEVICES` based on `num_replicas`. Each replica gets the same number of devices The alg. applies only when `CUDA_VISIBLE_DEVICES` is not set The diff uses `nvidia-smi` to determine the number of GPUs meta-pytorch#297 meta-pytorch#377 Differential Revision: D34064433 fbshipit-source-id: 3fee285d7b17d77abdbee8d9049f63b3a582943e
aivanou
force-pushed
the
export-D34064433
branch
from
3fc8732 to
2f8e937
Compare
|
This pull request was exported from Phabricator. Differential Revision: D34064433 |
…-pytorch#383) Summary: Pull Request resolved: meta-pytorch#383 The diff adds automatic set of `CUDA_VISIBLE_DEVICES` based on `num_replicas`. Each replica gets the same number of devices The alg. applies only when `CUDA_VISIBLE_DEVICES` is not set The diff uses `nvidia-smi` to determine the number of GPUs meta-pytorch#297 meta-pytorch#377 Reviewed By: kiukchung Differential Revision: D34064433 fbshipit-source-id: 03719702eeaff1b8f5dfcc0c9cd36d54ff660499
|
This pull request was exported from Phabricator. Differential Revision: D34064433 |
aivanou
force-pushed
the
export-D34064433
branch
from
2f8e937 to
9b9f0bb
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary:
The diff adds automatic set of
CUDA_VISIBLE_DEVICESbased onnum_replicas.Each replica gets the same number of devices
The alg. applies only when
CUDA_VISIBLE_DEVICESis not set#297
#377
Differential Revision: D34064433